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Sir: 
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ffj The undersigned points out that the executed application being filed herewith includes 

p pages 1 - of the executed declaration which were forwarded to the undersigned by facsimile 
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by Applicants 1 Japanese representative on June 30, 2000, and pages 1-75 of the specification 
(with Figures 1 - 27) which were earlier forwarded to the undersigned by facsimile by 
Applicants 1 Japanese representative. Further, the undersigned has been advised by the 
Japanese representative that the inventor had reviewed the application before executing the 
declaration. 

Accordingly, Applicant respectfully submits that the present application is properly 
executed and should be considered as filed in executed form. However, if the U.S. Patent 
and Trademark Office determines that the present application is not properly executed, 
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Applicant respectfully requests that the present application be treated as an unexecuted 
application under 37 C.F.R. 1.53(f). 

Should there be any questions regarding this paper, please contact the undersigned at 
the below listed number. 
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IMAGE PROCESSING COMPUTER SYSTEM 
FOR PHOTOGRAMMETRI C ANALYTICAL MEASUREMENT 



BACKGROUND OF THE INVENTION 
5 1 • Field of the Invention 

The present invention relates to an image -processing 
computer system for a photogrammetric analytical measurement , 
O in which a survey map is electronically produced based on a 
Cm pair of photographed pictures obtained at two different 
CtO photographing positions * 

o 

□ 2 . Description of the Related Art 

s For example, photogrammetry is carried out at a traffic 

51 accident spot- The traffic accident spot is photographed by 

hi 

□ an electronic still video digital camera in at least two 

d 

different positions, and a survey map of the traffic accident 
spot is produced based on a pair of photographed pictures 
obtained at the different positions , as disclosed in, for 
example, Unexamined Japanese Patent Publications No. 10-221072 
and No. 10-293026. 

20 Before accurately scaled distances and lengths can be 

reproduced on the survey map, a standard measurement scale or 
target must be recorded together with the photographed objects 
in the pictures. The target is disclosed in, for example, 
Unexamined Japanese Patent Publications No . 10-141951 , No.10- 

25 170263, No. 10-185562, No . 10-185563 , No . 10-293026 , No. 10-307025 
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and No .11-295065. 

For the production of the survey map, a two-dimensional 
coordinate system is defined on each of the pictures, and two- 
dimensional positions of the objects, which are recorded on 
5 each picture, are determined by the two-dimensional coordinate 
system. Also, a three-dimensional coordinate system is 
defined on the target, and three-dimensional positions of the 
^ recorded objects are determined based on the two-dimensional 

y3 

Sj positions of the objects with respect to the three-dimensional 
=J0 coordinate system. Accordingly, it is possible to produce a 

O survey map by projecting the three-dimensional coordinates, 

CD 

£ representing the objects, on one of the three planes defined 

las? 

fTi by the three-dimensional system. Of course, the production of 

3 3 

O the survey map is performed using an image-processing computer 
35 system. 

For example, to produce a long portion of a roadway as 
a survey map, it is necessary to obtain plural pairs of 
pictures to cover the length of the roadway, and the target 
must be moved from one position to smother position in the 

20 length of the roadway. In this case, a survey map section is 
produced based on each pair of pictures, and the survey map is 
obtained by successively connecting the survey map sections to 
each other. Of course, the production of all the survey map 
sections must be united with respect to a single three- 

25 dimensional coordinate system defined on the target located at 
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a previously-selected position . Thus , when the plural pairs 
of pictures are processed using the image-processing computer 
system by an operator to produce the survey map, it must be 
always known by the operator which target position each pair 
5 of pictures features and where each picture is photographed, 
resulting in facilitation of the production of the survey map. 
However, in reality, it is difficult to visually recognize the 
circumstances of a picture among other many pictures . 
q SUMMARY OF THE INVENTION 

CftO Therefore, an object of this invention is to provide an 

CO image processing computer system for a photogrammetric 
p analytical measurement, which is constituted such that the 
~ circumstances of each picture to be processed to produce a 
ff: survey map can be visually and easily recognized, resulting in 
pi 5 facilitation of the production of the survey map. 
P l In accordance with an aspect of the present invention, 

there is provided an image processing computer system for a 
photogrammetric analytical measurement in which a survey map 
is produced by connecting at least two sets of pictures 
20 featuring a photographed target located at a given target 

position. The image processing computer system comprises: a 
monitor that displays a scene including a picture-display area 
and an editing-display area; a first monitor controller that 
selectively displays only one picture in each set on the 
25 picture-display area of the scene; a second monitor controller 
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that transfers a displayed picture from the picture-display 
area to the editing -display area and vice versa; and a third 
monitor controller that visually displays a connection 
relationship between pictures displayed on the editing-display 
5 area of the scene . 

In accordance with another aspect of the present 
invention, there is provided an image processing computer 

O 

y=j system for a photogrammetric analytical measurement in which a 

S=i survey map is produced by connecting a first group including 

ff-- 

JS) at least a set of pictures featuring a photographed target 
located at a first target position and a second group 
including at least a set of pictures featuring a photographed 

f\ target located at a second target position to each other. The 
image processing computer system comprises : a monitor that 

H ? 5 displays a first scene including a picture-display area and an 
editing-display area; a first monitor controller that 
selectively displays only one picture in a set included in the 
first: group and only one picture in a set included in the 
second group, on the picture-display area of the first scene; 

20 a second monitor controller that transfers a displayed picture 
from the picture-display area to the editing-display area and 
vice versa; and a third monitor controller that visually 
displays a connection relationship between pictures displayed 
on the editing-display area of the first scene . 

25 Preferably, a display of pictures on the picture- 
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display area and the editing-display area is performed at a 
reduced size. 

When each of the first and second groups includes at 
least two sets of pictures, all respective pictures, included 
5 in the sets forming each group, are displayed on the picture- 
display area in photographing order under control of the first 
monitor controller. When one of the respective pictures, 
□ included in the sets forming each group, is transferred from 
|Jt the picture-display area to the editing-area and vice versa, a 
Sp transfer of the remaining pictures may be simultaneously 

q performed under control of the second monitor controller. 

ff'i 

2"' Also, when one of the respective pictures, included in 

fft the sets forming each group, is transferred from the picture- 
pi display area to the editing-area, a -transfer of the remaining 
3?> pictures may be simultaneously performed under control of the 
second monitor controller, and all the respective pictures, 
included in the sets forming the other group, may be displayed 
on the picture-display area under controller of the first 
monitor controller. 
20 The image processing computer system may further 

comprises a transfer-indicator that indicates a picture to be 
transferred from the picture-display area to the editing- 
display area and vice versa. In this case, a marker is 
displayed on the editing-display area under control of the 
25 second monitor controller to indicate a location, at which the 
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picture is to be transferred from the picture-display area to 
the editing-display area, when the picture is indicated by the 
transfer-indicator • 

Preferably, the marker comprises a frame representing 
5 an outline of the picture to be transferred from the picture- 
display area to the editing-display area, and is movable under 
control of the second monitor controller in the editing- 

sssr. 

y display area. 

For the visual connection-relationship between pictures 

JTO displayed on the editing-display area of the first scene, a 

M 

U connecting- strip is displayed on the editing-display area 

^ under control of the third monitor controller to indicate the 

01 connection relationship between the pictures displayed on the 

U 

O editing-display area of the first scene. Preferably, the 

OS connecting- strip is displayed as a strip connected between the 

centers of the two adjacent pictures at the back faces 

thereof . 

The image processing computer system may further 
comprise a fourth monitor controller that moves a picture , 

20 transferred from the picture-display area to the editing- 
display area, from one location to another location on the 
editing-display area, and a movement-indicator that indicates 
a picture to be moved on the editing-display area. A marker 
may be displayed on the editing-display area under control of 

25 the fourth monitor controller to indicate a location, at which 
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the picture is to be moved/ when the picture is indicated by 



comprises a frame representing an outline of the picture to be 
moved on the editing-display area. 



comprises a connection-indicator that indicates a picture, 
displayed on the picture-display area, and a picture, 
displayed on the editing-display area, to be connected to each 
other when the former picture is transferred to the editing- 
display area, and a fourth monitor controller that changes the 
first scene of the monitor into a second scene in which a 
connection-processing for connecting the pictures to each 
other is performed before the former picture is transferred to 
the editing-display area. In this case, preferably, two 
pictures, included in a set forming the first group, and two 
pictures, included in a set forming the second group, are 
displayed on the second scene of the monitor under control of 
the fourth monitor controller for the connection-processing. 
Further, preferably, the two pictures, included in a set 
forming the first group, and the two pictures, included in a 
set forming the second group, have at least two common 
connecting- image-points for the connection-processing . 



invention, there is provided an image processing method for a 
photogrammetric analytical measurement in which a survey map 



the movement- indicator . Preferably, the maker concerned 



The image processing computer system may further 



In accordance with yet anther aspect of the present 
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is produced by connecting a first group including at least a 
set of pictures featuring a photographed target located at a 
first target position and a second group including at least a 
set of pictures featuring a photographed target located at a 
5 second target position to each other. The image processing 
method comprises steps of: displaying a scene, including a 
picture-display area and an editing-display area, on a 
% monitor; selectively displaying only one picture in a set 
L? included in the first group and only one picture in a set 

included in the second group, on the picture-display area of 

y the scene; transferring a displayed picture from the picture- 

m 

!L display area to the editing-display area; and visually 

.==*; 

displaying a connection relationship between pictures 
□ displayed on the editing-display area of the scene. 
C15 In accordance with still yet another aspect of the 

present invention, there is provided a memory medium storing 

an image processing program for executing the above-mentioned 

method . 

BRIEF DESCRIPTION OF THE DRAWINGS 
20 The object and other objects of the present invention 

will be better understood from the following description, with 

reference to the accompanying drawings , in which : 

Figure 1 is a plan view of a roadway for explaining a 

photogrammetric analytical measurement, which is utilized by a 
25 photogrammetric image processing computer system according to 
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the present invention; 

Figure 2 is a conceptual schematic view showing an 

example of a format of a memory card, which is detach ably held 

in an electronic still video digital camera utilized in the 
5 photogrammetric analytical measurement, and which is loaded in 

the photogrammetric image processing computer system according 

to the present invention ; 
O Figure 3 is a block diagram of the photogrammetric 

Ijl image processing computer system according to the present 
: ¥p invention ; 

q Figure 4 shows a conceptual perspective view showing a 

~~ positional relationship between the camera and a target when 
S performing a photographing operation at a first photographing 
^ position; 

35 Figure 5 is a geometrical and conceptual illustration 

of the positional relationship shown in Fig . 4 ; 

Figure 6 is an actual view of a picture photographed at 
the first photographing position shown in Fig. 4; 

Figure 7 is a geometrical and conceptual illustration 
20 showing a transformation of a second scene coordinate system, 
defined on the target moved from the position shown in Fig. 4; 

Figure 8 is a view showing a connection -mode scene of a 
monitor included in the photogrammetric image processing 
computer system according to the present invention; 
25 Figure 9 is a view, similar to Fig. 8, showing the 
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connection-mode scene at an aspect different from Fig. 8 ; 

Figure 10 is a view, similar to Fig. 8, showing the 
connection-mode scene at another aspect different from Fig. 8; 
Figure 11 is a view of a scene changed from the 
5 connection-mode scene of the monitor shown in Fig* 10; 

Figure 12 is a view, similar to Fig. 8, showing the 
connection-mode scene at yet another aspect different from 
O Fig. 8; 

m Figure 13 is a view, similar to Fig. 8/ showing the 

s'"''s 

|$ connection-mode scene at yet further another aspect different 
□ from Fig. 8; 

s Figure 14 is a flowchart for an object-connecting 

ffj. routine executed in the photogrammetric image processing 
q computer system according to the present invention ; 
15 Figure 15 is a flowchart for a subroutine executed in 

step S100 of the object-connecting routine of Fig. 14; 

Figure 16 is a flowchart for a subroutine executed in 
step S200 of the object-connecting routine of Fig. 14; 

Figure 17 is a flowchart for a subroutine executed in 
20 step S300 of the object-connecting routine of Fig. 14; 

Figure 18 is a flowchart for. a subroutine executed in 
step S400 of the object-connecting routine of Fig. 14; 

Figure 19 is a flowchart for a subroutine executed in 
step S500 of the object-connecting routine of Fig. 14; 
25 Figure 20 is a flowchart for a subroutine executed in 
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step S600 of the object-connecting routine of Fig. 14; 

Figure 21 is a flowchart for a subroutine executed in 
step S700 of the object-connecting routine of Fig. 14; 

Figure 22 is a flowchart for a subroutine executed in 
5 step S800 of the object-connecting routine of Fig. 14; 

Figure 23 is a flowchart for a subroutine executed in 
step SHOO of the subroutine of Fig. 21; 

□ Figure 24 is a flowchart for a subroutine executed in 
m step $1200 of the subroutine of Fig. 21; 

W Figure 25 is a flowchart for a subroutine executed in 

:=3; . . 

□ step S1300 of the subroutine of Fig. 21; 

s Figure 26 is a flowchart for a subroutine executed in 

m step S1400 of the subroutine of Fig. 21; and 

n Figure 27 is a flowchart for a subroutine executed in 

step S1500 of the subroutine of Fig- 21. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 

With reference to Fig. 1, a roadway is shown as a plan 
view, by way of example, for explaining a photogrammetric 
analytical measurement which utilizes by a photogrammetric 

20 image processing computer system of the present invention- In 
this example, the roadway is photographed by an electronic 
still video digital camera 50 (Fig. 4) at eighteen 
photographing positions , which are represented by small solid 
circles indicated by references Ml to M18, respectively. Each 

25 of the eighteen pictures, photographed at the photographing 
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positions Ml to M18 / is processed by a control circuit of the 
digital camera 50, and Is then stored as a frame of image data 
in a memory medium, such as an IC memory card, held in the 
camera 50, The memory card is loaded in the photogrammetric 
5 image processing computer system according to the present 

invention/ and a survey map of the roadway is produced on the 
basis of the eighteen frames of image data read from the 

0 memory card, as stated in detail hereinafter. 

01 Each of the photographing positions Ml to M18 is 

UP defined as a back principal point M (Fig 4) of a photographing 
g optical system of the digital camera 50. As shown in Pig. 1, 
5 an arrow is projected from each of the photographing positions 
gi Ml to Ml 8 to indicate a photographing direction at the 
n corresponding photographing position (Ml, M2 , - M17 ,M18) . The 
photographing direction is defined as an orientation of an 
optical axis of the photographing optical system of the 
digital camera 50 . 

The eighteen photographing operations are performed in 
the order of the photographing positions Ml to M18. Also, 
20 when each of the photographing operations is performed, an 

object to be surveyed is photographed together with a target, 
indicated by reference TG (Fig. 4) , which serves as a standard 
measurement scale. In Fig. 1, although three targets TG are 
shown, only one target TG is used. Respective bracketed 
25 references RPl, RP2 and RP3, appended to the references TG, 
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represents target positions at which the target TG is to be 



located . 



In the example of Fig. 1, the target TG is initially 



located at the first target position RPl r and the first, 
5 second, third, fourth, fifth and sixth photographing 

operations are performed at the positions Ml to M6 . After the 

completion of the sixth photographing operation, the target TG 
~S is moved from the first target position RP1 to the second 
~ target position RP2, and the seventh, eighth, ninth and tenth 
SX) photographing operations are performed at the positions M7 to 
:J M10 . After the completion of the tenth photographing 
L, operation, the target TG is further moved from the second 
f] target position RP2 to the third target position RP3 , and the 
y eleventh, twelfth, thirteenth, fourteenth, fifteenth, 
45 sixteenth, seventeenth and eighteenth photographing operations 

are performed at the positions Mil to M18 . 



detecting the movement of the target TG, as disclosed in 
Unexamined Japanese Patent Publication No* 11-295065, and a 

20 tilt*- angle sensor for detecting a tilt-angle of the target TG, 
as disclosed in Unexamined Japanese Patent Publication No. 10- 
185563. Whenever the target TG is moved from a position to 
another position, the movement sensor detects a movement of 
the target between the two positions, and outputs a signal 

25 representing the movement of the target TG. The tilt-angle 



The target TG is provided with a movement sensor for 
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sensor detects a tilt- angle o£ the target TG to a horizontal 
plane when being located on the roadway, and outputs a tilt- 
angle signal representing the detected tilt-angle. 

The target TG is further provided with a signal 
5 processor for processing the respective signals output from 
the movement sensor and the tilt-angle sensor, and a radio 
transmitter for transmitting the processed signals to a 
receiver provided in the camera 50. The transmission of the 
Hi signals from the radio transmitter is repeated at regular 
^0 intervals of very short time. Whenever a photographing 
y operation is performed by the camera 50, and the transmitted 
3_ signals are retrieved from the receiver by the control circuit 
CP of the camera 50. The retrieved signals are processed by the 
O control circuit of the camera 50, and are then stored in the 
05 memory card, together with a corresponding frame of image data 
obtained by the photographing operation. 

An object to be surveyed is twice photographed by the 
camera 50 at two different photographing positions and in two 
different photographing directions . Namely, the two 
20 photographing operations are consecutively performed by the 
camera 50 with respect to the object to be surveyed, and a 
pair of pictures, on which the object to be surveyed is 
recorded, is obtained by the two consecutive photographing 
operations . 

25 In particular, while the target TG is located at the 
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first target position RP1, a first pair of pictures is 
obtained by the consecutive first and second photographing 
operations at the positions Ml and M2 , a second pair of 
pictures is obtained by the consecutive third and fourth 
5 photographing operations at the positions M3 and M4, and a 
third pair of pictures is obtained by the consecutive fifth 
and sixth photographing operations M5 and M6. The first, 
Q second and third pairs of pictures form a first group of 
ffi pictures featuring the first target position RP1 of the target 
5) TG. 

Q Also, while the target TG is located at the second 

s target position RP2 , a fourth pair of pictures is obtained by 
m the consecutive seventh and eighth photographing operations at 
□ the positions M7 and M8, and a fifth pair of pictures is 
35 obtained by the consecutive ninth and tenth photographing 

operations at the positions M9 and M10. The fourth and fifth 
pairs of pictures form a second group of pictures featuring 
the second target position RP2 of the target TG. 

Further, while the target TG is located at the third 
20 target position RP3, a sixth pair of pictures is obtained by 
the consecutive eleventh and twelfth photographing operations 
at the positions Mil and M12 , a seventh pair of pictures is 
obtained by the consecutive thirteenth and fourteenth 
photographing operations at the positions M13 and M14, an 
25 eighth pair of pictures is obtained by the consecutive 

-15- 



FROM mmtfl ' - _ 2000$ 6^29B») 17:30^17:27/^4801 158657 P 17 



fifteenth and sixteenth photographing operations M15 and M16, 
and a ninth pair of pictures is obtained by the consecutive 
seventeenth and eighteenth photographing operations at the 
positions Ml 7 and M18. The sixth, seventh, eighth and ninth 
5 pairs of pictures form a third group of pictures featuring the 
third target position RP3 of the target TG. 

Xn order for the production of the survey map of the 

q roadway , nine survey map sections are produced on the basis of 
the first, second, third, fourth, fifth, sixth, seventh, 
eighth and ninth pairs of pictures, respectively, and then are 

q successively connected to each other. 

For the connection between one of the first, second and 

jSj third map sections, derived from the first group of pictures, 

2; and one of the fourth and fifth map sections, derived from the 

j|5 second group of pictures, a first set of markers MK1 and MK2 
is located between the first and second target positions RP1 
and RP2, and the first set of markers MK1 and MK2 is 
photographed in at least one pair of pictures, included in the 
first group of pictures, and in at least one pair of pictures, 

20 included in the second group of pictures. 

Similarly, for the connection between one of the fourth 
and fifth map sections, derived from the second group of 
pictures, and one of the sixth, seventh, eighth and ninth map 
sections, derived from the third group of pictures, a second 

25 set of markers MK3 and MK4 is located between the second and 
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third target positions RP2 and RP3, and the second set of 
markers MK3 and MK4 is photographed in at least one pair of 
pictures, included in the second group of pictures , and in at 
least one pair of pictures, included in the third group of 
5 pictures * 

In Fig. 1, respective bracketed references RCl and RC2 , 
appended to the references MKl and MK2 , represent connection 
U= points for connecting two survey map sections derived from the 
CP first and second groups of pictures. Similarly; respective 
OLD bracketed references RC3 and RC4, appended to the references 
□ MK3 and MK4 , represent connection points for connecting two 
s survey map sections derived from the second and third groups 
fji of pictures. 

O In Fig, 1, although each of the markers MKl , MK2 , MK3 

r|5 and MK4 is shown as a small solid triangle , it may comprise a 
cone-shaped marker. In this case, the connection point is 
represented by an apex of the cone-shaped marker. 

In the example of Fig. 1/ a single set of markers may 
be used for the two sets of markers (MKl and MK2; MK3 and 
20 MK4) . Of course, in this case, the single set of makers are 
initially located between the first and second target 
positions RP1 and RP2, and is then moved to a location between 
the second and third target positions RP2 and RP3 after the 
photographing operations for the second group of pictures are 
25 completed. 

-17- 
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Note, in Fig. 1, references WL indicate white lines 
painted along the sides of the roadway, and references WM 
indicate white traffic symbols painted on the roadway. 

Figure 2 conceptually shows a format of the IC memory 
5 card held in the camera 50. As shown in this drawing, a 

memory area of the memory card is sectioned into a plurality 
of memory-area sections, some of which are indicated by 
O references PD n _2' PD n-l' PD n PD n+l' an< * eac *> °f the memory- 

CP area sections (», ^^-2' PD n-l' PD n and PD n+l' * includes an 
3p image area IMD, a header area H and a margin area SP. Of 
□ course, the image area IMD is provided for storing a frame of 

; : : 

~ image data representing a photographed picture. The header 
fji area H is sectioned into subheader areas Hi, H2, H3 and H4 for 
Q storing various particular data concerning the photographed 
[45 picture. The margin area SP is provided for distinguishing 
between the two adjacent memory area sections FD n and K> n+1 . 

The subheader areas Hi is provided for storing a title 
data of the photographed picture, and the title data is input 
by manipulating character<-inputting-switch buttons provided on 
20 a camera body of the camera 50, if necessary. 

The subheader area H2 is provided for storing two kinds 
of number data: a frame number data representing a 
photographing order and a target-position number data 
representing a target-position (RPl, RP2, RP3) of the target 
25 TG. 
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For the frame number data, a frame number counter la 
defined in the control circuit of the camera 50, and, for 
example, is initially set to be "0". Whenever a photographing 
operation is performed by the camera 50, the frame number 
5 counter is incremented by "1", and is stored as the frame 
number data in a corresponding subheader area H2 . For 
example, when the first photographing operation is completed 
D at the position Ml, the frame number data is stored as "1" in 
yl the subheader area H2 of the first memory-area section PD X , and 
CtQ when the eighteenth photographing operation is completed at 

G the position M18, the frame number data is stored as "18" in 

83 

the subheader area H2 of the eighteenth memory-area section 

p For the target-position number data, a target-position- 

rt5 number counter is defined in the control circuit of the camera 
50, and, for example, is initially set to be "1". Whenever a 
movement of the target T6 from one position to another 
position is confirmed by detecting the movement-signal 
transmitted from the radio transmitter of the target TG, the 
20 target-position -number counter is incremented by "1", and, 

whenever a photographing operation is completed by the camera 
50, a count number data of the target-position -number counter 
data is stored as the target-position number data in a 
corresponding subheader area H2 . Thus , when each of the 
25 first, second, third, fourth, fifth and sixth photographing 
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operations is completed, the target-position number data is 
stored as "1" in the subheader area H2 of each memory-area 
section (PD^ PD € ) . Also, when each of the seventh , eighth, 
ninth and tenth photographing operations is completed, the 
5 target-position number data is stored as "2" in the subheader 
area H2 of each memory-area section (pd 7 , , PD 10 ) . Further, 
when each of the eleventh, twelfth, thirteenth, fourteenth, 
Q fifteenth, sixteenth, seventeenth and eighteenth photographing 
Off operations is completed, the target-position number data is 
XD stored as "3" in the subheader area H2 of each memory-area 
p section (PD 1X , PD 18 ) * 

s In short, the photographed pictures, included in the 

gl first group, are featured by "1" as the target-position number 
g data; the photographed pictures, included in the second group, 
f|5 are featured by u 2" as the target-position number data; and the 
photographed pictures, included in the third group, are 
featured by M 3" as the target-position number data . 

The subheader area R3 is provided for storing a 
photographing date data, a focus-distance data, a horizontal 
20 view-angle data, a vertical view-angle data, a resolving-power 
data of a CCD (charge-coupled device) image sensor, used in 
the camera 50, and so on. These data are automatically stored 
in the subheader area H3 by the control circuit of the camera 
50 whenever a photographing operation is completed. 
25 The subheader area H4 is provided for storing the tilt- 
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angle data of the target TG, which are derived from a tilt- 
angle signal transmitted from the radio transmitter of the 
target TG. Namely, as mentioned above , whenever a 
photographing operation is performed by the camera 50, and the 
5 tilt-angle signal is retrieved from the receiver by the 

control circuit of the camera 50, and the retrieved signal is 
processed by the control circuit of the camera 50, thereby 
Q producing the tilt- angle data to be stored in the subheader 

m ha. 

1$ With reference to Fig. 3, the photogrammetric image 

p processing computer system according to the present invention 
is shown as a block diagram. 

The image processing computer system comprises: a 
q central processing unit (CPU) 14; a display device 10, such as 
M a CRT monitor; a display controller 16 for controlling the 
monitor 10; a display memory 20 for storing image data on 
which a scene to be displayed on the monitor 10 is based; an 
input device 12 including a keyboard and a mouse; an input- 
device controller 17 for controlling the input device 12; a 
20 memory-card driver 18 for loading the memory card, indicated 
by reference 13; and a working memory 19 used as a cash memory 
when executing calculations and processings in the CPU 14. 
The input-device controller 17, the working memory 19, the 
display memory 20, the memory-card driver 18 and the display 
25 controller 16 are connected to the CPU 14 via a bus 15. 
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As conceptually shown in Fig. 3, the CPU 14 includes an 
input-state managing section 41, a display-state managing 
section 42, a connection-processing section 43, and a data- 
managing section 44 . 
5 The input-state managing section 41 manages various 

information data and command data input through the input 
device 12. For example, when a cursor or pointer is moved on 
P the monitor by manipulating the mouse of the input device 12, 
Q-i the movement of the pointer is managed by the input-state 

managing section 41. Also, by the input-state managing 
g section 41, it is monitored whether character code data is 
l~ input through the keyboard of the input device 12, and, when 
~ the character code data is input, the character code data is 

converted into image data, which is output to the display 
3$ memory 20 . 

The display-state managing section 42 manages a scene 
to be displayed on the monitor 10. For example, when at least 
a part of the scene displayed on the monitor 10 is changed, 
the change of the scene is managed by the display-state 
20 managing section. Namely, writing of image data in the 

display memory 20 is controlled by the display-state managing 
section. 42, thereby changing the scene displayed on the 
monitor 10 , The display controller 16 repeatedly reads the 
image data from the display memory 20 at a regular interval of 
25 given short time, and converts the read image data into a 
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three primary (red, green and blue) video data. 

The connection-processing section 43 processes the 
above-mentioned connection of the survey map sections to each 
other, thereby producing the survey map of the roadway, as 
5 stated in detail hereinafter. 

The data -managing section 44 manages various data read 
from the memory card 13 through the memory-card driver 18, 
^ survey map data, various data necessary for producing the 
yj survey map data and so on. 

£9 After the eighteen photographing operations are 

O completed by the camera 50 at the photographing positions Ml 
^ to M18 , as shown in Fig. 1, the memory card 13 is removed from 
Em the camera 50, and is then loaded in the memory-card driver 
G 18. Of course, the loaded memory card 13 stores the eighteen 
£p frames of image data obtained by the eighteen photographing 

operations performed at the positions Ml and M18 . 

The eighteen frames of image data are read from the 

memory card 13 through the memory-card driver 18, and are once 

stored in the working-memory 19, Then, each of the eighteen 
20 photographing positions Ml, M2, , M17 and M18 is spatially 

determined with respect to the target TG on the basis of the 

corresponding frame of image data. 

Referring to Figs. 4 to 6, the spatial determination of 

the first photographing position Ml with respect to the target 
25 TG will be representatively explained. 
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Figure 4 shows a positional relationship between the 



camera 50 and the target TG when performing the photographing 
operation at the first photographing position Ml . In the 
positional relationship of Fig. 4, of course, the target TG is 
5 within a view-angle defined by the photographing lens system 
of the camera 50, boundaries of the view-angle being indicated 
by references FF. Also, the optical axis of the photographing 
g lens system of the camera 50 is indicated by reference Ol . As 
ffl stated hereinbefore, the first photographing position Ml is 

SSI? 

i§ defined as the back principal point M of the photographing 

q optical system of the camera 50, As is apparent from Fig. 4, 

£0 

. the target TG has an L- shaped configuration, and is provided 

fpl with reference points 32, 34 and 36. A line segment between 

S the reference points 32 and 34 is perpendicular to a line 

5$ segment between the reference points 34 and 36, and both the 



Referring to Fig. 5, the positional relationship of 
Fig. 4 is geometrically and conceptually illustrated. In this 
drawing, reference F indicates an image plane defined by the 
20 photographing lens system of the camera 50, and the picture 
formed on the image plane F is indicated by reference IM1. 
The picture XMl, of course, corresponds to the first picture 
photographed at the position Ml (Fig. 1) , and is actually 
shown in Fig. 6. 

25 As shown in Fig. 5, the optical axis Ol passes through 



line segments have a same length. 
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a center C of the image plane F or picture IMl, and a distance 
between the center C and the back principal point M (Ml) is 
defined as a focal distance f . A three-dimensional X s -Y 3 -Z s 
coordinate system is defined on the target TG located at the 
5 first target position RPl, as shown in Fig. 5. Namely/ the 
origin of the X s -Y g -Z g coordinate system is at the reference 
point 34 of the target TG, the X fi -axis coincides with the line 
O segment between the reference points 32 and 34, and the Z s -axi& 
Oj coincides with the line segment between the reference points 
£0 34 and 36. Of course, the Y--axis is perpendicular to both the 
O X s ~ and Z a -axes . Note, the X 3 -Y g -Z s coordinate system , defined 
* on the target TG located at the first target position RPl , is 
En referred to as a first scene coordinate system hereinafter. 
q The survey map Is produced by projecting three- 

jj> dimensional coordinates representing an image point on a plane 
defined by the X g - and z^-axes of the first scene coordinate 
system (X g -Y s -Z g ) , and the plane concerned must be horizontal 
before the production of the survey map can be properly 
performed. Nevertheless , the target TG cannot necessarily be 

20 horizontally positioned on the roadway when being located at 

o 

the first target position RPl . Thus , if the target TG is 
tilted with respect to a horizontal plane, the plane concerned 
is also tilted. The tilt of the target TG is corrected on the 
basis of the tilt-angle data, which is derived from the tilt- 
25 angle signal transmitted from the radio transmitter of the 
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target TG. Accordingly, although the target TG is tilted, it 
is possible to properly perform the definition of the first 
scene coordinate system (X g -Y g -Z g ) . 

In Fig. 5, a distance between the reference points 32 
5 and 34 is represented by reference LT, and thus a distance 
between the reference points 34 and 36 can be represented by 
the same reference LT, because the respective line segments 
q between the reference points 32 and 34 and between the 
^ reference points 34 and 36 have the same length, as mentioned 

above. Accordingly, as shown in Fig. 5, the reference point 
rf 32 is represented by the coordinates P gl (-LT, 0, 0), the 

to 

*y- reference point 34 is represented by the origin coordinates 

m P S2* 0 ' °' 0) , and the reference point 36 is represented by the 

hi 

:T coordinates J? s3 (0, 0, LT) . 

W) The back principal point M (Ml) is determined with 

respect to the first scene coordinate system (X s -Y g -Z s ) , To 
this end, a two-dimensional X p -Y p coordinate system is defined 
on the image plane F or first picture IM1, as shown in Figs. 5 
and 6, and a three-dimensional X c -Y c -Z c coordinate system is 

20 defined on the camera 50, as shown in Fig. 5. 

As best shown in Fig. 6, the origin of the X p -Y p 
coordinate system coincides with the center C of the image 
plane F or first picture IM1, and the X p - and Y p -axes extend 
horizontally and vertically, respectively. The reference 

25 points 32, 34 and 36 photographed on the first picture IM1 are 
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represented by two-dimensional coordinates p 1 (xp 1 , yp x ) / 
p 2 txp 2' yp 2 ) and p 3 (xp 3 , yp 3 ) , respectively. Note, the X p -Y p 
coordinate system is referred to as a picture coordinate 
system hereinafter. 
5 Also, as shown in Fig. 5, the origin of the X c -Y c -Z c 

coordinate system coincides with the back principal point M 
(Ml) , the Z c -axis coincides with the optical axis Ol, and the 
P respective X^- and Y c -axes are in parallel to the the x p - and 
m Yp-axes of the two-dimensional coordinate system X p -Y p . The 
IB origin of the X^-Y^-Z^ coordinate system or back principal 
g point M is represented by three-dimensional coordinates M(AX, 
7 AY, AZ) which are based on the first scene coordinate system 
p (X fi -Y s -Z s ) . An orientation of the Z c -axis or optical axis 01 
22; is represented by three-dimensional angular coordinates (a, (S, 
15 y) which are defined with respect to the first scene 

coordinate system (X S ~Y S -Z S ) . Namely, the Z c -axis or optical 
axis 01 defines angles of a, 3 and y with the X s ~, Y s - and Z $ - 
axes of the first scene coordinate system, respectively. 

When two-dimensional coordinates p ± (xp ±/ yp,^ (i = 1, 
20 2, 3), representing the coordinates p^xp^ yp x ) , p 2 {xp 2 , yp 2 ) 
and p 3 (xp 3 , yp 3 ) based on the picture coordinate system (X p -Y p ) 
are expressed by three-dimensional coordinates * 0 ii* ax ±* P eyi' 
P ozi ) based on the camera coordinate system (X c -Y c -Z c ) , the X- 
co ordinate xp^ and the Y-coordingate yp i are represented by the 
25 following formulas (1) and (2), respectively: 
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- f < P cyi/ P czx) ■ < 2 > 
Herein: "i" = 1, 2 or 3, and M f w is the focal distance. 

On the other hand, the three-dimensional coordinates 

P ci (P cxi/ P eyi / p CZ i) based on the camera coordinate system (X c - 

Y c -Z c ) is expressed by three-dimensional coordinates p si ( p sac i/ 

P - , P .) based on the scene coordinate system (X--Y--Z-) as 

follows : 

P ci " R < P si - *> - (3) 

cos $ cos y co s as xix y^s±nas±xx/3cos y sin as In y- cosaslnficos y 

- cos /3st±n y cos etc as y- s±n<ys±nfis±n y s Inacos y¥ cosas±n(3s±n y 
sln/3 ~s±nacos0 aosctcosj3 

'ax 

AY 



A ~ 



AZ 



25 



Herein: *R W is a rotational matrix of the angles a, [3, Y/ and 
"A" is a vector representing a movement distance the origin of 
the camera coordinate system (X c -Y c -Z c ) from the origin of the 
scene coordinate system (X 3 -Y 3 -Z 3 ) . 

In short, the three-dimensional coordinates M(AX, AY, 
AZ) and the three-dimensional angular coordinates (a, 3/ Y) 
are calculated by the formulas (1) , (2) and (3) , whereby the 
back principal point M or first photographing position Ml is 
spatially determined with respect to the scene coordinate 
system (X s -Y g -Z s ) , 
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In reality, each of -the reference points 32, 34 and 36 
is represented as a small white circle, which is formed at a 
center of a circular black plate element attached to an L~ 
shaped member. By suitably processing a frame of image data 
5 read from the memory card 13, the small white circles, 

representing the reference points 32, 34 and 36, are extracted 
from the frame of image data, whereby coordinates of each 
8 «i reference point (32, 34, 36) are determined. Namely, in the 
ffi example shown in Figs . 4 to 6 , the determination of the 
|fi coordinates P sl (-LT, 0, 0), * s2 < 0 / °r °> and p s3< 0 ' °' LT > are 
g automatically executed by the CPU 14 on the basis of the frame 
^ of image data obtained at the first photographing position Ml. 
;2 The remaining photographing positions M2 to M18 are 

:£ spatially determined in substantially the same manner as 
J3E5 mentioned above. Of course, the spatial determination of the 
photographing positions M2 to M6 are executed with respect the 
first scene coordinate system (X g -Y $ -Z s ) defined on the target 
T6 located at the first target position RPl, the spatial 
determination of the photographing positions M7 to M10 are 
20 performed with respect to a second scene coordinate system 

defined on the target TG located at the second target position 
RP2 , and the spatial determination of the photographing 
positions Mil to Ml 8 are executed with respect to a third 
scene coordinate system defined on the target TG located at 
25 the third target position RP3 . 
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Not©, the above-mentioned spatial determination of the 
photographing positions Ml to M18 is automatically executed 

i 

when the eighteen frames of image data are read from the 
memory-card 13 . 

5 When the survey map of the roadway is produced by 

successively connecting the nine survey map sections to each 
other , the spatial determination of all the eighteen 
p photographing positions Ml to M18 must be united with respect 
rp to any one of the first, second and third scene coordinate 
jO systems. For example, when the first scene coordinate system 
g (X s -Y s -Z 3 ) is selected for the determination of all the 
7 photographing positions Ml to M18, the second and third scene 
j=r; coordinate systems must be transformed into the first 

coordinate system (X s -y s -z s ) . 
Jt5 Referring to Fig. 7, the transformation of the second 

scene coordinate system into the first scene coordinate system 
(X e -Y g -Z g ) is conceptually shown. In this drawing, the three 
axes of the second scene coordinate system are indicated by 
references X g ' , Y g ' and Z s ', and the movement of the target TG 
20 from the first target position RP1 to the second target 

position RP2 is represented by two-dimensional coordinates 
(X^, Z df) ) based on the first scene coordinate system (X g -Y g - 
Z s ) . Also, an angle of £ indicates a relative rotational angle 
of the target TG between the first and second target positions 
25 RP1 and RF2. In Fig. 7, each of references 02 , 07 and 08 
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So 



as 



Indicates an orientation of the optical axis of the camera 50 
located at the corresponding photographing position (M2, M7, 
M8) . 

The two-dimensional coordinates (X^, z dp ) and the 
rotational angle of £ arQ determined by calculating the three- 
dimensional coordinates of the connection points RC1 and RC2 
of the cone-shaped markers MK1 and MK2 with respect to the 
first and second scene coordinate systems ( x s ~ Y s~ z s' x s~*s"" 
2 S ') , respectively. 

After the determination of the two-dimensional 
coordinates (X^, Z^) and the rotational angle of the 
transformation of the second scene coordinate system (X s '-Y s '- 
Z s ') into the first scene coordinate system (X s -Y g -Z s ) is 
performed on the basis of the following formula (4) : 
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20 Of course , the transformation of the third scene 

coordinate system into the first scene coordinate system (X s - 
Yg-Zg) is performed in substantially the same manner as 
mentioned above. 

Figure 8 shows, by way of example; a connection-mode 

25 scene, displayed on the monitor 10 for executing a processing 
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for successively connecting the nine pairs of pictures to each 
other. Note, the connection-mode scene is selected from an 
initial menu scene (not shown) displayed on the monitor 10 
after the image processing computer system is powered ON. As 
5 shown in Fig, 8, the connection-mode scene includes a picture- 
display area GDA and an editing-display area CEA. 

As shown in Fig. 8/ a part of the pictures included in 
f*l the first group are displayed on the picture-display area GDA. 

J As mentioned above, the first group of pictures , featuring the 

6 

l|p target TG located at the first target position RF1, is 

5 composed of the first pair of pictures (Ml, M2) , the second 

J" pair of pictures (M3, M4) and the third pair of pictures (MS, 

M6) , and only one picture in each pair is representatively 

^ displayed on the picture-display area GDA. in the example 

5=3? 
=S3i 

35 shown in Fig. 8, the displayed pictures IMl, IM3 and IMS are 
obtained at the first, third and fifth photographing positions 
Ml, M3 and MS. Namely , the pictures IMl, IM3 and IMS are 
disposed in the photographing order. The display of the 
pictures IMl, IM3 and IMS on the picture-display area GDA is 

20 performed at a reduced size, and the reduced sized pictures 
IMl, IM3 and IMS are referred to as objects OBl, OB2 and OB3, 
respectively , hereinafter , 

Note, of course, image data for the objects OBI, OB2 
and OB3 are produced on the basis of the first/ third and 

25 fifth frames of image data read from the memory card 13 , and 
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are stored in the display memory 20. 

As shown in Fig. 8, an advancing button GGA and a 
returning button GGR are displayed adjacent to the top of the 
picture-display area GDA. When the advancing button GGA is 
5 operated by clicking on it with the mouse , the scene of the 
picture-display area GDA is changed such that a part of the 
pictures included in the second group are displayed thereon in 
q substantially the same manner as the part of the pictures 
J included in the first group. When the advancing button GGA is 
JS) further operated by clicking on it with the mouse, a part of 
5j the pictures included in the third group are displayed on the 

picture -display area GDA in substantially the same manner as 
'% the part of the pictures included in the first group. On the 

S _ 

i: other hand, whenever the returning button GGR is operated by 

Jij5 clicking on it with the mouse, the scenes of the picture- 
display area GDA are successively returned. In short, by 
suitably, operating the buttons GGA and GGR, it is possible to 
selectively display any one of the above-mentioned three parts 
of the pictures on the picture-display area GDA. 

20 The editing-display area CEA is used as a visual 

editing area for editing the pictures or objects . As shown in 
Fig. 8, mode-setting buttons ARM, MVM and DIM are displayed 
adjacent to the top of the editing-display area CEA. 

The mode setting button ARM serves as an object- 

25 transferring/connecting-mode button. When the button ARM is 
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operated by clicking on it with the mouse, the button ARM is 
displayed an object- transfer ring/ connecting mode is set* In 
reality, the operated button ARM is displayed as if being 
depressed, whereby it is possible to visually confirm the 
5 setting of the object- transferring/ connecting mode. In this 
mode, the pictures or objects are transferred from the 
picture-display area GDA to the editing-display area CEA, and 
^ are visually connected to each other, as mentioned in detail 
^ hereinafter. Note, whenever the connection-mode scene (Fig. 
K) 8) is selected from the initial menu scene of the monitor 10, 

z : : 

jS; the object-transferring/connecting mode is forcibly set. 

The mode setting button MVM serves as an object- 
Jrf arranging-mode button. When the button MVM is operated by 

Li I 

jjf clicking on it with the mouse, an object-arranging mode is 

&5 set. The operated button MVM is also displayed as if being 
depressed, whereby the setting of the object-arranging mode 
can be visually confirmed. In this mode, the pictures or 
objects can be optionally arranged on the editing-display area 
CEA, as mentioned in detail hereinafter. 

20 The mode setting button DIM serves as an object- 

dele ting -mode button. When the button DLM is operated by 
clicking on it with the mouse, an object-deleting mode is set. 
Similarly, the operated button DLM is displayed as if being 
depressed, whereby the setting of the object-deleting mode can 

25 be visually confirmed. In this mode, the pictures or objects 
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can be deleted from the editing-display area CEA, and the 
deleted objects can be again displayed on the picture-display 
area GDA. 

Note, in Fig. 8, the operated button ARM is hatched so 
5 as to be distinguished from the non-operated buttons MVM and 
DLM. 

In the object-transferring/connecting mode (ARM) , for 
p example , when the object OBI is indicated by clicking on it 
Of with the mouse, the object OBI is encompassed by a single-dot- 
AO line frame, as shown in Fig. 8, whereby the object OBI is 
q visually distinguished from the remaining objects 0B2 and 0B3. 
7 Then, when the pointer (not shown) is moved in the editing- 
S display area CEA by manipulating the mouse, a broken-line 
S frame GM is displayed on the editing-display area CEA such 
3|> that the pointer is surrounded by the broken-line frame GM. 

When the pointer is moved within the editing -display area CEA 
by manipulating the mouse, the pointer takes with it the 
broken-line frame GM. Thus, the broken-line frame GM can be 
positioned at a given location by the pointer. After the 
20 positioning of the broken-line frame GM, when a clicking 

operation is performed with the mouse, all the objects OBI, 
OB2 and OB 3 are once transferred from the picture-display area 
GDA to the editing-display area CEA, as shown in Fig. 9. 

The transferred objects OBI, OB2 and OB 3 are connected 
25 to each other in the photographing order by connecting- strips 
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CNS displayed on the editing-display area CEA, whereby it is 
possible to visually recognize the relationship between the 
objects OBI , OB2 and OB3 . Each of the displayed connecting- 
strips CMS behaves just like a rubber strip connected between 
5 the centers of the two adjacent objects (OBI and OB2 or OB2 
and OB3) at the back faces thereof. Namely, for example, if 
the object OBI is moved apart from the remaining objects OB2 
a and OB3 in the object-arranging mode, the connecting- strip CNS 

~? is displayed as being extended between the centers of the 

y * 

|0 objects OBI and OB2. 

2 In the scene of Fig. 9, as mentioned above, when the 

ffl object-deleting button DIM is operated by clicking on it with 
D the mouse, the object-deleting mode is selected. In this 
W mode, when one of the objects OBI, OB2 and OB3 is indicated by 
£5 clicking on it with the mouse, all the objects OBI, OB2 and 
OB3 are deleted from the editing-display area CEA, and are 
then displayed on the picture-display area GDA. Namely, the 
scene of Fig. 9 is returned to the scene as shown in Fig. 8. 
As shown in Fig. 9, as soon as the transfer of the 
20 objects OBI, OB2 and OB3 from the picture-display area GDA to 
the editing-display area CEA is performed, the part of the 
pictures included in the second group is displayed on the 
picture-display area GDA, regardless of the operation of the 
advancing button GGA. Namely, the objects OB4 and OB5, which 
25 correspond to the pictures IM7 and IM9 obtained at the 
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photographing positions M7 and M9, respectively, are displayed 
on the picture-display area GDA, Of course, image data for 
the objects OB4 and OB5 are produced on the basis of the 
seventh and ninth frames of image data read from the memory 
5 card 13, and are stored in the display memory 20. 

The objects OB4 and OB5 (IM7 and IH9) are based on the 
target TG being located at the second target position RP2 . 
g Thus , before the objects OB4 and OB5 can be connected to the 
S objects OBI , OB2 OB3 based on the target TG being located at 
B) the first target position RPl, it is necessary to execute a 

processing for transforming the second scene coordinate system 
7 (Xg'-Yg'-Zg F ) into the first scene coordinate system (X s -Y s -Z s ) . 
i5j For the transformation of the second scene coordinate 

IZ system into the first scene coordinate system, one of the 

w 

W objects OB 4 and OB5 and one of the objects OBI , OB2 and OB3 to 
be connected to each other are selected. For example, as 
shown in Fig. 10, the objects OB4 and OB 3 to be connected to 
each other are selected, and the selection of each object 
(OB4, OB3) is performed by clicking on it with the mouse, 

20 whereby each of the selected objects OB 4 and OB3 are 

encompassed by a single-dot-line frame, as shown in Fig. 10. 
Then, when the pointer is moved in the editing-display area 
CEA by manipulating the mouse, a broken-line frame GM appears 
on the editing-display area CEA (Fig. 10) , with the pointer 

25 indicating the center of the broken-line frame GM. After the 
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broken-line frame GM is positioned at a given location by the 
pointer, when a clicking operation is performed with the 
mouse, the scene (Fig. 10) of the monitor 10 is changed into a 
scene as shown in Fig. 11. 
5 On the scene of Fig. 11, the third pair of pictures IM5 

and IM6 and the fourth pair of pictures IM7 and IM8 are 
displayed. Of course, the third pair of pictures IMS arid IM6 
^ are obtained at the photographing positions MS and M6, and are 
~ based on the target TG being located at the first target 
jfij) position RP1, and the fourth pair of pictures IM7 and 1MB are 
y obtained at the photographing positions M7 and M8, and are 
W based on the target TG being located at the second target 

.L=ti 

y position RP2 . 

y As shown in Fig. 11, the respective connection points 

ft RC1 and RC2 of the cone-shaped markers MK1 and MK2 (Fig. 1) 
are displayed as image points RC15 and RC25 on the picture 
IMS, and are displayed as image points RC16 and RC26 on the 
picture IM6 . Also, the respective connection points RCl and 
RC2 of the cone-shaped markers MK1 and MK2 are displayed as 

20 image points RC17 and RC27 on the picture XM7, and are 

displayed as image points RC18 and RC28 on the picture IM8. 

Also, on the scene of the monitor 10 shown in Fig. 11, 
a first designation button KB1 , a second designation button 
KB2, a completion button OFN and a cancel button OCS are 

25 displayed. 
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When the first designation button KBl is operated by 
clicking on it with the mouse, a first designation mode is 
selected to designate the image points RC15, RC16, RC17 and 
RC18- In the first designation mode, when the image points 
5 RC15 and RC16 are consecutively designated by clicking on them 
with the mouse, three-dimensional coordinates of the 
connection point RC1 are calculated with respect to the first 
scene coordinate system (X s -X s -Z s ) . Also, when the image 
points RC17 and RC18 are consecutively designated by clicking 
Sp on them with the mouse, three-dimensional coordinates of the 
y connection point RC1 are calculated with respect to the second 
w scene coordinate system (Xg'-Yg'-Zg 1 ) - 

3 When the second designation button KB2 is operated by 

W clicking on it with the mouse, a second designation mode is 
jja selected to designate the image points RC25, RC2 6, RC27 and 
RC28. In the second designation mode, when the image points 
RC25 and RC26 are consecutively designated by clicking on them 
with the mouse, three-dimensional coordinates of the 
connection point RC2 are calculated with respect to the first 
20 scene coordinate system (Xg-Yg-Zg) . Also, when the image 

points RC27 and RC28 are consecutively designated by clicking 
on them with the mouse, three-dimensional coordinates of the 
connection point RC2 are calculated with respect to the second 
scene coordinate system (Xg'-Yg'-Zg 1 ) . 
25 Thus, it is possible to determine not only a relative 
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movement distance of the target TG from the first target 
position RP1 to the second target position RP2 but also a 
relative rotational angle of the second scene coordinate 
system (Xg'-Yg'-Zg') with respect to the first scene coordinate 
5 system <X S -Y S -Z 3 ) . Of course, the determined movement distance 
and the determined rotational angle represent the coordinates 
* x dp' z <ip* an< * t * xe an ^ G of respectively, as explained with 
reference to Pig. 7. In short, by the designation of the 
2 image points (RC15 , RC16, RC17 and RC18; and RC25, RC26, RC27 
jjO and RC28) , the transformation of the second scene coordinate 
^ system (X 3 , -Y s '-Z s ') into the first scene coordinate system (X s ~ 
w Y s ~ z s ) is P erforTO ®<* on the basis of the above-mentioned formula 
^ (4) , whereby the photographing positions M7 , M8, M9 and M10 
^ are expressed with respect to the first scene coordinate 
j|5 system (X S ~Y S -Z S ) , resulting in connection between the first 
group of pictures (IM1 to IM6) and the second group of 
pictures (IM7 to IM10) . 

After the designation of the image points (RC15, RC16, 
RC17 and RC18; and RC25, RC26, RC27 and RC28) , the completion 
20 button OFN is operated by clicking on it with the mouse, the 
scene (Fig. 11) of the monitor 10 is changed into a scene as 
shown in Fig. 12. As is shown in this drawing, the objects 
OB4 and OB5 are transferred from the picture-display area GDA 
to the editing-display area CEA, and the objects OB4 and OB5 
25 are successively connected to the object OB3, included in the 
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first group, by connecting- strips CNS. 

In the scene of Fig. 11 , when it is perceived that the 
designation of a pair of image points (RC15 and RC16; RC17 and 
RC18; RC2S and RC26; RC27 and RC28) is erroneously performed, 
5 the designation concerned is canceled by operating the cancel 
button OCS by clicking on it with the mouse. Thereafter, the 
designation can be tried again* 
^ As shown in Fig. 12, as soon as the transfer of the 

% objects OB4 and OB5 from the picture-display area GDA to the 

y = 

SO editing-display area CEA is performed, the part of the 
% pictures included in the third group is displayed on the 
w picture-display area GDA, regardless of the operation of the 
y advancing button GGA. Namely, the objects OB6, Ob7, OB8 and 
JjJ OB9, which correspond to the pictures IM11, IM13, IM15 and 
45 IMZL7 obtained at the photographing positions Mil, M 13, M15 
and M17, respectively, axe displayed on the picture-display 
area GDA. Of course, image data for the objects OB6, Ob7, OB8 
and OB9 are produced on the basis of the eleventh, thirteenth, 
fifteenth and seventeenth frames of image data read from the 
20 memory card 13 / and are stored in the display memory 20, 

Note, in Figs, 12 and 13, each of the objects OB6, 0B7, 
OB8 and OB 9 is shown as a blank frame for the sake of 
convenience . 

Similar to the above-mentioned cases, the objects OB6, 
25 Ob7, OB8 and OB9 can be transferred from the picture-display 
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area GDA to the editing-display area CEA, and can be connected 
to the second group of the objects in substantially the same 
manner as explained above with respect to the objects OB4 and 
OB5 included in the second group. 
5 For example, in the scene of the Fig. 12, when the 

object- arranging mode is selected by operating the object- 
arranging-mode button MVM by clicking on it with the mouse, 
O the objects OBI, OB2, OB3, OB4 and OB5, connected to each 
£n other by the connecting-strips CNS, can be optionally 
CEP rearranged on the editing-display area CEA, as shown in Fig. 
p 13 in which the operated button MVM is hatched to indicate the 
s setting of the object-arranging mode. 

ffi In particular, when one of the objects OBI, OB2, OB3, 

p OB4 and OB5 is indicated by clicking on it with the mouse, the 
:¥5 indicated object is encompassed by a single-dot-line frame, 
just like the object OB4 shown in Fig. 10. Then, when the 
pointer (not shown) is out of the indicated object, a broken- 
line frame (GM) , as shown in Fig. 8 or 10, is displayed on the 
editing-display area CEA such that the pointer is surrounded 
20 by the broken-line frame (GM) . When the pointer is moved 

within the editing-display area CEA by manipulating the mouse, 
the pointer takes with it the broken-line frame (GM) . Thus, 
the broken-line frame (GM) can be positioned at a given 
location by the pointer. After the positioning of the broken- 
25 line frame (GM) , when a clicking operation is performed with 
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the mouse, the indicated object is moved from an original 

position shown in Fig. 12 to a new position shown in Fig, 13. 

In this way, the objects OBI, OB2 , OB3, OB4 and OB5 shown in 

Fig. 12 can be rearranged as shown in Fig. 13. 
5 In short, the objects can be optionally arranged on the 

editing-display area CEA in accordance with an operator's taste 

or choice. For example, the rearrangement of the objects are 
_ performed such that the operator or photographer can be easily 

reminded of the photographing scenes, resulting in 
yO facilitation of the production of the survey map. 

Note, it is apparent from Fig. 13 that each of the 
^ displayed connecting-strips CNS behave just like a rubber 
^ strip connected between the centers of the two adjacent 
UJ objects at the back faces thereof when each of the objects is 
d5 moved. 

Also, note, of course, in the scene of Fig. 9, when the 
object-arranging mode is set, it is possible to rearrange the 
objects OBI, OB2 and OB3 . 

In the scene of Fig. 12 or 13, when one of the objects 

20 OBI, OB2 and OB3 is indicated by clicking on it with the mouse 
in the object-deleting mode (DLM) , all the objects OBI, OB2 
and OB3 are deleted from the editing-display area, and are 
then returned to the picture-display area 6DA. Similarly, 
When one of the objects OB4 and OB5 is indicated by clicking 

25 on it with the mouse, both the objects OB4 and OB5 are deleted 
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from the editing-display area CEA, and are then returned to 
the picture-display area GDA. 

The first group of objects OBI, OB2 and OB3, the second 
group of objects OB4 and 0B5, and the third objects OB6, OB7 , 
5 OB8 and OB9 are displayed on only one of the picture-display 
area GDA and the editing-displayed area CEA. Namely, each of 
the first, second and third groups cannot be simultaneously 
q displayed on both the picture-display area GDA and the 
fS editing-displayed area CEA. 

3$ For this end, a GDA-list memory area and a CEA-list 

5; memory area are defined in the working memory 19. Respective 
^ r object-numbers "1" to W 9 H , which represent the objects OBI to 
OB9 are initially stored in the GDA-list memory area, whereby 
the first, second and third groups of objects (OBI, OB2 and 
4^5 OB3; OB4 and OB5; and OB 6, OB7, OB 8 and OB 9) are enabled to be 
selectively displayed on the picture-display area GDA, as 
explained with reference to Fig. 8. On the other hand, the 
CEA-list memory area are initially cleared, whereby the first, 
second and third groups of objects cannot be displayed on the 
20 editings-display area CEA, 

For example, when the first group of objects OBI, OB2 
and OB3 are transferred from the picture-display area GDA to 
the editing-display area CEA, the object-numbers "1", *2 n and u 3 m 
are cleared from the GDA-list memory area, and the cleared 
25 object-numbers M l", u 2 n and "3" are added to the CEA-list memory 
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area, whereby the first group of objects OBI , OB2 and OB3 are 
enabled to be displayed on the editing-display area CEA, but 
cannot be displayed on the picture-display area GDA. On the 
contrary, when the first group of objects OBI, OB2 and OB3 are 
5 returned from the editing-display area CEA to the picture- 
display area GDA, the object-numbers T, a 2" and "3 n are cleared 
from the CEA— list memory area, and the cleared object-numbers 
"l", "2" and "3" are added to the GDA-list memory area. Of 



DP! course, this is true for the second and third groups of 

3l0 objects (0B4 and OB5; and OB 6, OB7, OB8 and OB9) . 

□ The scenes of the monitor 10, shown in Figs. 8, 9, 10, 

s 12 and 13, include a setting-menu-display area MSA which is 



p fixing button DBM displayed thereon . When the button DST is 
QL5 operated by clicking on it with the mouse, various setting- 



menus are displayed on the setting-menu-display area MSA. 
Among the setting-menus, for example, there are a size- 
altering menu for altering a size of an object (OBI to OB9) or 
picture (IM1 to XM18) to be displayed, and a connecting-strip- 
20 altering menu for altering a width, a color or the like of a 
connecting- strip (CNS) to be displayed. Each of the setting- 
menus has various setting-items, and an alteration of a 
setting is performed by indicating a corresponding setting- 
item by clicking on it with the mouse. After the alteration 



25 of the setting is completed, when the setting-fixing button 



associated with a setting-alteration button DST and a setting- 
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DM4 is operated, by clicking on it with the mouse, the 
alteration of the setting is fixed, and the setting-menus 
disappear from the set ting -menu- display area MSA. 

Further , on the scenes shown in Figs. 8, 9, 10 , 12 and 
5 13, a completion button CIB and a cancel button CSB are 

displayed. After the objects (OBI to OB9) are successively 
connected -to each other, whet£^Jthe coanpletion button CIB is 
^ operated by clicking on it with the mouse, the connection data 
*0 between the objects (OBI to OB 9) are stored in a suitable 
Q.0 memory medium (not shown) , such as a hard disc, provided in 
E3 th« image processing computer system, and the connection -mode 
CO scene of the monitor 10 is returned to the initial menu scene. 
Q Also, whenever the cancel button CSB is operated by clicking 
Ly on it with the mouse, a processing concerned for connecting 
rt5 objects to each other is canceled. 

Figure 14 shows a flowchart for an object-connecting 
routine, which is executed when the connection-mode scene is 
selected from the initial menu scene of the monitor 10, as 
shown in Fig. 8. Note, when an execution of the object- 
20 connecting routine is started, the above-mentioned spatial 
determination of the photographing positions Ml to M18 is 

already completed. {' 

f 

At step Sll, the connection-mode scene is displayed on 
the monitor 10 in a blank manner such that no objects are 
25 displayed on the picture-display area GDA and the editing- 
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display area CEA. Then, at step S12, a variable "MODE" is made 
to be "1", whereby the objeot-transf erring/connecting mode is 
set on the connection-mode scene of the monitor 10, because 
the object-transferring/connecting mode is forcibly set when 
5 the connection-mode scene is selected from the initial menu 
scene of the monitor 10, as mentioned above* Namely, when the 
variable •MODE" is u l", it indicates the setting of the object- 
transferring/ connec ting mode on the., connection -mode scene . 
J3 Note, when the object-arranging-mode button MVM is 

© operated by clicking on it with the mouse, the object- 
O arranging mode is set, whereby the variable "MODE" is made to 
ED be "2", and, when the object-dele ting-mode button DLM is 
Q operated by clicking on it with the mouse, the object-deleting 
hj mode is set, whereby the variable "MODE" is made to be "3". 
jj? At step S13, all the object-numbers "1" to "9", which 

™ represent the objects OBI to OB9, respectively; are added to 
the GDA-lis t . memory area defined in the working memory 19, and 
the CEA-list memory area defined in the working memory 19 is 
cleared , 

20 At step S14, variables "ADDNUM* and "EDITNUM* are reset 

to be "0". The variable "ADDNUM* is used to represent whether 
one of the objects, displayed on the picture-display area GDA, 
is indicated by clicking on it with the mouse. When the 
indication of an object on the picture-display area GDA is 

25 confirmed, the variable "ADDNUM" is made to be an object-number 
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corresponding to the indicated object. For example, as shown 
in Fig. 8, when the object OBI is indicated by clicking on it 
with the mouse, the variable "ADDNUM" is made to be "l". The 
variable "EDITHUM" is used to represent whether one of the 
5 objects, displayed on the editing-display area CEA, is 
indicated by clicking on it with the mouse. When the 
indication of an object on the editing-display area CEA is 
^ confirmed, the variable "EDITNUM* is made to be an object- 
^5 number corresponding to the indicated object. For example, as 
QlO shown in Fig. 10, the object OB3 is indicated by clicking on 
O it with the mouse, the variable "EDITNUM* is made to be "3". 
ffl At step S15, the first group of objects OBI, OB2 and 

5 

O OB3 is displayed on the picture-display area GDA in accordance 
UJ with the object-numbers listed on the GDA- list memory area. 
SL5 Thus, the scene of the monitor 10 corresponds to one as shown 
in Fig- 8 except that the broken-line frame GM is displayed on 
the editing-display area - CEA . . 

At step S16, it is monitored whether the pointer is 
entered into the editing-display area CEA by manipulating the 
20 mouse. When the pointer is in the editing-display area CEA, 
the control proceeds to step S100, in which a subroutine SBR1 
is executed. The subroutine SBR1 is to manage a display of 
the broken-line frame GM on the editing-display area CEA. 
Note, the subroutine 3BR1 is explained in detail with 
25 reference to Fig. 15 hereinafter. 
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At step S16, when the pointer is not in the editing- 
display area CEA, the control proceeds to step S17 , in which 
it is monitored whether a clicking operation is performed with 
the mouse. When the clicking operation is not confirmed, the 
5 control returns to step S16. 

At step S17, when the clicking operation is confirmed, 
the control proceeds to step SIB, in which it is determined 
whether a predetermined area is indicated by the pointer 
yQ during the performance of the clicking operation. 
QO At step S18, when the predetermined area, indicated by 

O the pointer, is either the advancing button GGA or the 
fQ returning button GGR, the control proceeds to step S200, in 
Q which a subroutine SBR2 is executed. Note, the subroutine 
hi SBR2 is explained in detail with reference to Fig. 16 
CJ5 hereinafter. 

~ At step S18, when the predetermined area, indicated by 

the pointer, is the object-transferring/connecting-mode button 
ARM, the control proceeds to step S300, in which a subroutine 
SBR3 is executed. Note, the subroutine SBR3 is explained in 
20 detail with reference to Fig. 17 hereinafter* 

At step S18, when the predetermined area, indicated by 
the pointer, is the object-arranging-mode button MVM, the 
control proceeds to step S400, in which a subroutine SBR4 is 
executed. Note, the subroutine SBR4 is explained in detail 
25 with reference to Fig. 18 hereinafter. 
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At step S18, when the predetermined area, indicated by 



the pointer, is the object-dele ting-mode button DLM, the 



control proceeds to step S50Q, in which a subroutine SBR5 is 
executed. Note, the subroutine SBR5 is explained in detail 
5 with reference to Fig. 19 hereinafter. 

At step S18, when the predetermined area, indicated by 
the pointer, i0 the picture-display area GDA, the control 
proceeds to step S600, in which a subroutine SBR6 is executed. 
C* Note, the subroutine SBR6 is explained in detail with 
□0 reference to Fig. 20 hereinafter. 

□ At step Si 8, when the predetermined area, indicated by 

CO the pointer, is the editing-display area cea, the control 

O proceeds to step S700, in which a subroutine SBR7 is executed. 

y Note, the subroutine 5BR7 is explained in detail with 

nL5 reference to Fig. 21 hereinafter. 

At step S18, when the predetermined area, indicated by 
the pointer, is the completion button CIB, the control 
proceeds to step S800, in which a subroutine SBR8 is executed. 
Note, the subroutine SBR8 is explained in detail with 
20 reference to Fig. 22 hereinafter. 



one of the predetermined areas is indicated by the pointer 
during the performance of the clicking operation, the control 
returns to step Si 6. 



Note, at step S18, when it is not confirmed that any 



Figure 15 shows a flowchart for the subroutine SBR1 
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executed at step S100 of the object-connecting routine shown 
in Fig. 14. Of course, the execution of the subroutine SBR1 
is started when the clicking operation is performed provided 
that, the pointer is in the editing-display area CEA, 
5 At step S101, it is determined whether a broken-line 

frame GM is displayed on the editing-display area CEA* When 
the broken-line frame GM is not displayed on the editing- 
Pi display area CEA, the subroutine SBRl once ends. 
IK Note, as mentioned above, the broken-line frame GM is 

1 z : 
•es" • 

SO not displayed on the editing-display area CEA until an object 
rr is indicated by clicking on it with the mouse in either the 
^ picture-display area GDA or the editing-display area CEA, and 

2 an initial display of the broken-line frame GM is explained 
hereinafter . 

15 At step S101, when a broken-line frame GM is displayed 

on the editing-display area CEA, the control proceeds to step 
S102, in which- the. broken-line frame GM is eliminated from the 
editing-display area CEA. Then, at step S103, a new broken- 
line frame GM is displayed on the editing-display area CEA. 
20 The routine comprising steps S102 and S103 is xrepeated as long 
as the pointer is in the editing-display area CEA, whereby it 
is observed that the broken-line frame GM is moved together 
with the pointer in the editing-display area CEA. 

Figure 16 shows a flowchart for the subroutine SBR2 
25 executed at step S200 of the object-connecting routine shown 
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in Fig. 14. Of course, the execution of the subroutine SBR2 
is started when the clicking operation is performed provided 
that either the advancing button GGA or the returning button 
GGR is indicated by the pointer* 
5 At step S201, it is determined whether the advancing 

button GGA is operated by eliciting on it with the mouse. When 
the operation of the advancing button GGA is confirmed , the 
^ control proceeds to step S202, in which a next group of 
^ objects is displayed on the picture-display area GDA. Then, 
20 at step S203, both the variables "ADDNUM" and "EDITNUM" are 
O reset to be "0". Note, when the advancing button GGA is 
lD operated while the last or third group of objects OB6, OB7 , 
O OB8 and OB9 is displayed on the picture-display area GDA, the 
W first group of objects OBI, OB2 and OB3 is displayed on the 
CIS area GDA as the next group of objects . 

At step $201, when the advancing button GGA is not 
operated, i.e. when the returning button GGR is operated, the 
control proceeds to step S204, in which a preceding group of 
objects is displayed on the picture-display area GDA. Then, 
20 at step S203, both the variables "ADDNUM" and "KDITNUM" are 
reset to be "0". Note, when the returning button GGR is 
operated while the first group of objects OBI, OB2 and OB3 is 
displayed on the picture-display area GDA, the third group of 
objects OB6, OB7 , OB8 and OB9 is displayed on the area GDA as 
25 the preceding group of objects. 
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Figure 17 shows a flowchart for the subroutine SBR3 
executed at step S300 of the object-connecting routine shown 
in Fig. 14. Of course, the execution of the subroutine SBR3 
is started when the clicking operation is performed provided 
5 that the pointer is on the object-transferring/connection 
button ARM* 

At step S301, the variable ''MODE" is made to be "1* , 
and, at step S302, both the variables "ADDNUM" and "EDITNUM" are 
reset to be "0*. Then, at step S303, only the object- 
transferring/connecting-mode button ARM is displayed as if 

3 

p being depressed, thereby indicating the setting of the ob^ect- 
7 transferring/ connecting mode. 

2 Figure 18 shows a flowchart for the subroutine SBR4 

y ; 

% executed at step S400 of the object-connecting routine shown 
y.5 in Fig. 14* Of course, the execution of the subroutine SBR4 
is started when the clicking operation is performed provided 
that the object-arranging button MVM is indicated by the 
pointer , 

At step S401, the variable "MODE" is made to be "2" , 
20 and, at step S402, both the variables "ADDNUM" and "EDITNUM" are 
reset to be "0". Then, at step S403, only the object- 
arranglng-mode button MVM is displayed as if being depressed, 
thereby indicating the setting of the object-arranging mode. 

Figure 19 shows a flowchart for the subroutine SBR5 
25 executed at step S500 of the object-connecting routine shown 
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±n Fig. 14. Of course, the execution of the subroutine SBR5 
is started when the clicking operation is performed provided 
that the object-deleting button DIM is indicated by the 
pointer - 

5 At step S501, the variable ''MODE* is made to be "a", 

and, at step S502, both the variables "ADDNUM* and "EDITNUM" are 
reset to be "0". Then, at step S503, only the object-deleting- 
m mode button DLM is displayed as if being depressed , thereby 
JJ: indicating the setting of the object-deleting mode. 
JfO Figure 20 shows a flowchart for the subroutine SBR6 

y executed at step S600 of the object-connecting routine shown 
w in Fig. 14. Of course, the execution of the subroutine SBR6 
O i 5 started when the clicking operation is performed provided 
U? that the pointer is in the picture-display area GDA. 

JKZft 

05 At step S601, it is determined whether the variable 

"MODE" is "1", i.e. whether the object-transferring/connecting 
mode is selected. If MODE * 1, the subroutine SBR6 once ends. 
Namely , the clicking operation is ignored when the object- 
transf erring/connecting mode is not selected. 
20 At step S601, when it is confirmed that the object- 

transferring/connecting mode is selected (MODE ' 1) , the 
control proceeds to step S602, in which it is determined 
whether the clicking operation is performed provided that any 
one of the objects displayed on the picture-display area GDA 
25 is indicated by the pointer- If the pointer is out of the 
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object displayed on the area GDA, the subroutine SBR6 once 
ends. Namely, the clicking operation is ignored when the 
pointer is out of the object displayed on the area GDA. 

At step S602, when it is confirmed that the clicking 
5 operation is performed provided that the object is indicated 
by the pointer, the control proceeds to step S603, in which 
the variable "ADDNUM" is set to be an object-number 
3 corresponding to the indicated object. For example, as shown 
S in Fig. 8, when the object OBl is indicated by clicking on it 
So with the mouse, the variable "ADDNUM" is set to be "1". Then, 
J at step S604, the variable "EDITNUM" is reset to be "0". 

Figure 21 shows a flowchart for the subroutine SBR7 
1 executed at step S700 of the object-connecting routine shown 
3 in Fig. 14. Of course, the execution of the subroutine SBR7 

si 

il5 is started when the clicking operation is performed provided 
that the pointer is in the editing-display area CEA. 

At step S701, it is determined whether the clicking 
operation is performed provided that any one of the objects , 
displayed on the editing-display area CEA, is indicated by the 
20 pointer. When it is confirmed that the clicking operation is 
performed provided that the object is indicated by the 
pointer, the control proceeds to step S702, in which it is 
determined whether the variable "MODE" is "1". If MODE = 1, 
i.e. if the object- transfer ring/ connecting mode is selected, 
25 the control proceeds to step SHOO, in which a subroutine 
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SBRll is executed. Note, the subroutine SBR11 is explained in 
detail with reference to Fig. 23 hereinafter. 

At step S702, if MODE * 1, the control proceeds to step 
S703, in which it is determined whether the variable "MODE" is 
5 tt 2 n . If MODE -2, i.e. if the object-arranging mode is 
selected, the control proceeds to step S1200, in which a 
subroutine SBR12 is executed. Mote, the subroutine SBR12 is 
explained in detail with reference to Fig, 24 hereinafter. 
5 At step S703, if MODE * 2, i.e. if the object-deleting 

yjo mode is selected (MODE = 3) , the control proceeds to step 

5 — ^ 

^ S1300, in which a subroutine SBR13 is executed. Note, the 

O subroutine SBR13 is explained in detail with reference to Fig. 

^ 25 hereinafter. 

£m On the other hand, at step S701, when it is confirmed 

Us? 

8Q5 that the clicking operation, is performed provided that the 

O object is not indicated by the pointer, the control proceeds 
to step S704, in which it is determined whether the variable 
"MODE" is "2". If MODE =2, i.e. if the object- arranging mode 
is selected, the control proceeds to step S1400, in which a 

20 subroutine SBR14 is executed. Note, the subroutine SBR14 is 
explained in detail with reference to Fig. 26 hereinafter. 

At step S704, if MODE * 2, the control proceeds to step 
S705, in which it is determined whether the variable "MODE" is 
"i*. If MODE =1, i.e. if the object- transferring/connecting 

25 mode is selected, the control proceeds to step S150O, in which 
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a subroutine SBR15 is executed. Note, the subroutine SBR15 is 
explained in detail with reference to Fig. 27 hereinafter. 

At step S705, if MODE + 1, i.e. if the object-deleting 
mode is selected (MODE =3), the subroutine SBR7 once ends. 
5 Namely, in the object-deleting mode, the clicking operation , 
which is performed provided that the pointer is out of the 
object, is ignored. 

Figure 22 shows a flowchart for the subroutine SBR8 
y~i executed at step S800 of the object-connecting routine shown 

in 

f|0 in Fig, 14. Of course, the execution of the subroutine SBR8 
p is started when the clicking operation is performed provided 
m that the completion button CIB is indicated by the pointer. 
q Note, the completion button CIB is operated to end the 
Qj execution of the object- connecting routine of Fig. 14. 
J$ At step S801, various object-connection data, obtained 

™ by executing the object-connecting routine of Fig. 14, are 
suitably processed, and are then stored in the memory medium 
provided in thd image processing computer system. Then, at 
step S802, the connection-mode scene of the monitor 10, as 
20 shown in Fig. 8, 9, 10, 12 or 13, is returned to the initial 
menu scene (not shown) . 

Figure 23 shows a flowchart for the subroutine SBRll 
executed at step SHOO of the subroutine SBR7 shown in Fig. 
21. Of course, the execution of the subroutine SBRll is 
25 started when the clicking operation is performed provided that 
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the object displayed on the editing-display area CEA is 
indicated by the pointer (S701) , and provided that the object- 
transferring/eonnecting mode is selected (S702; MODE = 1) . 

At step S1101, it is determined whether the variable 
5 "ADDNUM" is not H 0 M ■ If ADDNUM * 0, i.e. if any one of the 
objects, displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1102, in which the variable "EDITNUM" is m ad e 
'% to be an object-number corresponding to the object indicated 
jio by clicking on it with the mouse in the editing-display area 
^ CEA (S701) . 

At step S1103, a broken-line frame GM is displayed on 
;L the editing-display area CEA so as to surround the pointer 
*f] displayed thereon. This situation is similar to that shown in 
55 Pig. 10, 

— *5 

O At step S1101, if ADDNUM = 0, i.e. if any one of the 

„ objects, displayed on the picture-display area GDA, is not 
indicated by clicking on it with the mouse , the subroutine 
SBR11 once ends. Namely, as long as any one of the objects, 
20 displayed on the area GDA, is not indicated by clicking on it 
with the mouse (ADDNUM = 0) , the indication of the object in 
the editing-display area CEA by clicking on it with the mouse 
(S701) is ignored in the object-transferring/connecting mode 
(MODE = 1) , 

25 Figure 24 shows a flowchart for the subroutine SBR12 
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executed at step S1200 of the subroutine SBR7 shown in Fig. 
21- Of course, the execution of the subroutine SBR12 is 
started when the clicking operation is performed provided that 
the object displayed on the editing-display area CEA is 
5 indicated by the pointer (S701) , and provided that the object- 
arranging mode is selected (S703; MODE = 2). 

-At step S1201, it is determined whether the variable 
"EDITNUM" is "0". If EDITNUM = 0, the control proceeds to step 
J= S1202, in which the variable "EDITNUM" is made to be an object- 
JiD number corresponding to the object indicated by clicking on it 
□ with the mouse in the editing-display area CEA (S701) . 
S5 At step S1203, a broken-line frame GM is displayed on 

L : the editing-display area CEA so as to surround the pointer 
fl displayed thereon. Thus, the indicated object concerned can 
y> be optionally rearranged in the editing-display area CEA, as 
w Stated hereinbefore with reference to Figs. 12 and 13. 

At step S1201, if EDITNUM = 0, i.e. if any one of the 
objects, displayed on the editing-display area CEA, has been 
already indicated by clicking on it with the mouse, the 
20 subroutine SBR12 once ends. Namely, the indication of the 
object in the editing-display area CEA concerned is ignored. 

Figure 25 shows a flowchart for the subroutine SBR13 
executed at step S1300 of the subroutine SBR7 shown in Fig. 
21. Of course, the execution of the subroutine SBR13 is 
25 started when the clicking operation is performed provided that 
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the object displayed on the editing-display area CEA is 
indicated by the pointer (S701) , and provided that the object- 
deleting mode is selected (S703; MODE = 3) . 

At step S1301, a set of object-numbers , one of which 
5 corresponds to the object indicated by clicking on it with the 
mouse (S701) , is eliminated from the CEA-list memory area. 
Then, at step S1302, the eliminated set of object-numbers is 
added to the GDA-list memory area, 
yg At step S1303, a display of objects is performed on the 

f|0 picture-display area 6DA based on the revised GDA-list memory 
Q area/ to which the eliminated set of object-numbers is added. 
m Then, at step S1304, a display of objects is performed on the 
q editing-display area CEA based on the revised CEA-list memory 
Hi area, from which the set of object-numbers is eliminated. Of 
3J5 course, the connecting-strips CNS for successively connecting 
~ the displayed objects to each other are displayed, whereby 
connection -relationships between the objects can be visually 
recognized. Subsequently, at: step S1305, both the variables 
"ADDNUM" and "EDITNUM" are reset to be "0". 
20 Figure 26 shows a flowchart: for the subroutine SBR14 

executed at step S1400 of the subroutine SBR7 shown in Fig. 
21. Of course , the execution of the subroutine SBR14 is 
started when the clicking operation is performed provided that 
the pointer is out of the objects on the editing-display area 
25 CEA (S701) , and provided that the object-arranging mode is 
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selected (S704; MODE = 2) . 

At step S1401, it is determined whether the variable 
"EDITNUM" is not u 0\ If EDITNUM * 0, i.e. if any one of the 
objects, displayed on the editing-display area CEA, has been 
5 already indicated by clicking on it with the mouse, the 

control proceeds to step S1402, in which the indicated object 
concerned is displayed at the new location to which the 
broken-line frame GM is moved by the pointer on the editing- 
% display area CEA. 

%0 At step S1401, if EDITNUM = 0, i.e. if any one of the 

objects, displayed on the editing-display area CEA, has not 
rj: been indicated by clicking on it with the mouse, the 
L : subroutine SBR14 once ends. Namely , as long as any one of the 
f\ objects, displayed on the editing-display area CEA, has not 

been indicated by clicking: on it with the mouse, the clicking 
w operation concerned is ignored. 

Figure 27 shows a flowchart for the subroutine SBR15 
executed at step S1500 of the subroutine SBR7 shown in Fig. 
21. Of course , the execution of the subroutine SBR15 is 
20 started when the clicking operation is performed provided that 
the pointer is out of the objects on the editing-display area 
CEA, and provided that the ob ject-tranof erring/connecting mode 
is selected (S705; MODE = 1) ♦ 

At step S1501, it is determined whether the variable 
25 "ADDNUM* is not a 0\ If ADDNUM * 0, i.e.- if any one of the 
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objects, displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1502 , in which it is determined whether the 
variable "EDITNUM" is not "0". If EDITNUM * 0, i-e. if any one 
of the objects, displayed on the editing-display area CEA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1503, in which the scene of the monitor 10, 
as shown in Fig. 10, is changed into the scene as shown in 
Fig. 11, thereby processing a connection between the object 
indicated in the picture-display area GDA (S1501) and the 
object indicated in the editing-display area CEA (S1502) . 

At step S1504, a pair of pictures (IMS and XM6) , 
represented by the object (OB5) corresponding to the variable 
"EDITNUM", and a pair of pictures (XM7 and IM8) , represented by 
the object (OB7) corresponding to the variable "ADDNUM", are 
displayed on the monitor 10 , as shown in Fig. 11. Then, at 
step 31505/ a movement distance and a rotational angle between 
two target positions (RP1 and RP2) are calculated on the basis 
of designations of image points , representing two connection 
points (RCl and RC2) , photographed in the two pairs of the 
pictures, as explained hereinbefore. 

At step S1506, it is monitored whether the completion 
button OFN has been operated by clicking on it with the mouse. 
When the operation of the button OFN is not confirmed, the 
control returns to step S1505. On the other hand, when the 
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operation of the completion button OFN is confirmed, i.e. when 
the calculations are completed, the control proceeds to step 
S1507, in which the scene of the monitor 10, as shown in Fig. 
11, is changed to the scene as shown in Fig* 12. 
5 At S1508, a set of object-numbers, one of which 

corresponds to the object indicated in the picture-display 
area GDA by clicking on it with the mouse (S1501) , is 
eliminated from the GDA- list memory area. Then, at step 

'% S1509, the eliminated set of object-numbers is added to the 

20 CEA-list memory area. 

J£ At step S1510, a display of objects is performed on the 

picture-display area GDA based on the revised GDA-list memory 
area, from which the set of object-numbers is eliminated* 
f: Then, at step S1511, a display of objects is performed on the 
4J5 editing-display area CEA based on the revised CEA-list memory 
y area, to which the eliminated. set of object-numbers is added* 
Of course,, the connecting-: strips CNS for successively 
connecting the displayed objects to each other are displayed, 
whereby connections-relationships between the objects can be 
20 visually recognized. Subsequently, at step S1512, both the 
variables "ADDNUM" and "EDITNUM" are reset to be "0". 

At step S1501, if ADDNUM = 0, i.e. if none of the 
objects, displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the subroutine 
25 SBR15 once ends. Namely, the clicking operation (S701) , which 
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is performed provided that the pointer is out of the object, 
is ignored. 

At step S1501, if ADDNUM * 0, and, at step S1502, if 
EDITNUM = 0, i.e. if only one of the objects, displayed on the 
5 picture-display area GDA, is indicated by clicking on it with 
the mouse, the control proceeds from step S1502 to step S1513, 
in which it is determined whether the CEA-list memory area is 
cleared. If the CEA-list memory area is cleared, i.e. if the 
S CEA-list memory area stores no object-number, the control 
MO jumps from step S1513 to step S1508, and the routine 
5 con£>rising steps S1508 to S1512 is executed, whereby only a 
S transfer of objects concerned from the picture-display area 
JU GDA to the editing-display area CEA is performed, as explained 
f! with reference to Figs. 8 and 9. 

8 i i 

y5 After all the pairs of pictures are successively 

connected to each other by executing the object-connecting 
routine shown- in Fig, 14, a routine for producing a survey map 
is executed. In the execution of the survey-map-producing 
routine, a survey map section is produced on the basis of each 
20 pair of pictures, and the survey map sections are connected on 
the basis of the connection data obtained by the execution of 
the object-connecting routine, thereby producing the survey 
map like the one shown in Fig . 1 . 

In the above-mentioned embodiment, at least three 
25 photographing operations may be performed to produce a survey 

-64- 



FROM m ' 2000$ 6fl29B(*) 17^^11 7 :27/J»W801 158657 P 66 



map section. Of course, in this case, although a set of at 
least three pictures is obtained, in reality, a pair of 
pictures is suitably selected from among the at least three 
pictures for the production of the survey map section. 
5 Finally, it will be understood by those skilled in the 

art that the foregoing description is of preferred embodiments 
of the system , and that various changes and modifications may 
be made to the present invention without departing from the 
gp spirit and scope thereof. 

f§0 The present disclosure relates to subject matter 

yj 

pi contained in Japanese Patent Application No. 11-188678 (filed 
m on July 2, 1999), which is expressly incorporated herein, by 
^ reference, in its entirety. 
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